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USING -STTJDEl-rr ?EKFOPilAj:CE TO f^EASUHE SZUPJCE TEACHING EFFECTrVTI.TSS 

How do you identify" a successful autonobile mechanic? How do you choose 
an effective iawer? or butcher? or detective? Should we watch how skillfully 
. the nechanic .uses a wrench, how cogently the lawyer speaks, how' artfully the 
butcher trims a roast, and how stealthily the detective stalks the criminal? Or 
should we exanine how well the car runs, how successfully- cases are prosecuted, 
rne taste and appearance of ©eat, and the nunber of criminals apprehended? 

Hew do you detemine if 'a teacher is effective? Do you examine the 
quality and quantity of their questions, the eloquence of their lectures, the 
length of th^i^r hair or skirts, or the nunber of tiroes they snile or frown? ^Cr 
do you watch to"^see how icany students are enfaged in learning?, how well they 
can read, whether they cap neasur-'S or weigh, ^nd whether the students seem con- 
fident and caln? * • . 

The questions don't seem difficult to answer. Skilled .workers and pro- 
fessionals are effective when they accorrplish the purpose of their jobs. We 
don't particularly care if mechanics are unshaven, if detectives are obtuse 
question aiskers, or if lawyers are flamboyant so long as ^hey accoinplish their 
purposes. 'Nor should we ^e excessively concerned with how teachers look and 
act when the influence they have on student achievenent is a cjore iniportant 
concern. 

The purpose of this paper is to argue the case for using student 

achievement as the primary ineans of measuring science teaching effectiveness. 

/ 
/ 

Propositions to support 'this argument will be presented. ah4- defended.- A num- 
ber of specific procedures will be g: — i for collecting dat-a from students to 
use in assessing teaching effectiveness. Finally, some problej^ and cautions 
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' yihan fcllowing the approaches suggested^ here will be examined. 

TKE.CASE FOR USIKG STUI^mT PERTORKA-NCE 

I - • ' . 

" ^ Four propositions will be presented and defe^ed rhat sunnarize rhe 

^ argUTDent favoring the \ise of student perfbrnance as the principal oeans of 

assessing the effectiveness of teachers. 

^ . * • 

Proposition 1 : Teachers are ecployed to help students leara. and should be 
assessed accordingly. 

A study was reported several years ago in which housewives, students and 
tradesmen were compared with teachers in their ability to teach students (Popham, 
1971); The result was a standoff in effectiveness and^thus, a clear defeat^ for 
teachers.^ Teachers would be 'expected ^o do better at their jobs than persons 
without special training and experience, but this was <iot the case. Should ue 
not ejq^ect certified teachers to be more effective than lay people and be will- 
ing to be assessed and rewarded by their effectiveness? 

Few schools are organized to reward teachers for being effective. In- 
stead the salary scheduler provide increments in pay (admittedly small in many 
cases) for every teacher .'^that stays employed and continues to aggregate course 
credit and advanced degrees. The teacher eyaluat ions* done in schools are often 
completed by a harried administrator or department head and focus on teacher ^ 
characteristics (e.g., smiles, neat appearance) or actions (e.g., asks high 
level questions, reinforces student responses). The result of both the evalua- 
tion system and the pay schedule is to focus attention away from the primary 
Amotion of the teacher — helping students learn. 



Proposition 2 : Teachers ncre effectivel;/ cevote rheir rir:e to teaching when 
they are being evaluated by the results' they, produqe. 

^t is difficult to operate a school in a highly efficient manner be- 
cause inany people with diverse opinions, purposes, and ideas* need to work 
together. Yet that built in inefficiency is coispounded by a teacher assess- 
ment system that focuses on the means of instiruction (i.e., the procedures 
teachers follow) instead of the results of instruction. Rather than reduce 
the inefficiency by directing assessments -nnd evaluations toward desired out- 
comes, we usually see a compounding of the problem by excessive attention to 
the appearance and actions of students and teachers. 

V/har happens when teachers are held responsible for student outcomes? 
There have not been many studies op this topic but a report by McNeil (1967) 
illustrates what could be achieved on a wide basis if teacher assessment was 
focused on outcomes. McNeil assigned elementary studen^ teachers to two 
gro\ips and directed them to^rark with pupils that had deficiencies in 
punctuation. One group of student teachers (control group )^ was told that 
they would be ^aded on their "professional characteristics and teaching ■ 
methods". The other group (experimental group) was told that they would be 
graded on their ability to remedy some of the punctuation problems of their 
pupils. Following a two veek period of instruction ♦ the elementary school 
pupils were evaluatec3* on their punctuation skills. Every measure of achieve- 
ment shov^ed that the pupils of the experimental^ teachers learned significantly 
more during the unit. 

The result of focusint^ teacher evaluation or. outcomes (student aqhieve- 
ment) rather than procedures (teacher actions), is to put teachers clearly on 
task. That is, they devote their time and energies more to direct instruction 



and less to peripheral and cor^metic concerns. When- teachers on tas?< it^ 
is reasonable to assunie that students are being given opportunities to learn • 
and 'that is the most certain way to ii^fluence school Achievement. A study^'in 
California (!dcDonald, 1976) showed that Student opportunity to learn was^ 
^strongly related to studenr achieivement. ' . . ^ 

Proposition 3 : .JToo little is known about the effects of teacher behaviors ' ^ 
to use the© as a basis for assessing teachers. 

^ ■ . - ' » * • . . -^ 

Several reviews have been .nade of studies that examined the relationships 

. ' i ' r • • . 

• between what teachers do -and what students leam /e.g., Rosenshine and Furst,. 

/l971). Fac .ors'like teacher enthusiasm and clarity ^ correlate positively and 
significantly with student outcoines.' But correlational findings dc not derx)n- 

. strate causes and effects. Because teacher enthusiasm is associated with high- 
er student achieverient doesn't^ mean that it causes it, — and that is the 
problem. Only a few studies have been done that show the direct, influence of 
teapher activities 'on student accomplishment Xe.p;-, Gage,* 1976, and Okey ^d 
Ciesla, ]973). r . - v • . ' ' - 

Experimental studies of the influence of teacher activities on student 
outcomes are needed to serve as a basis for planning teacher training and staff 
dev3lopn«nt projrpams. If teacher behaviors can be Identified that influence 
what sVudents leam, a PToat deal more direction is available for selecting 
behaviors and 'skills that teachers should spend time studying. 

The situation we find today concerning links between teacher behaviors* 
and student outcomes is one of hardly any experimental (i.e., cause and effect) 
findinps and only a few correlational hints. Ttosenshine (1976) has estimated - 
that no more than 25 studies have been reported' on even the most thoroughly 
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^ investigated teachin/r variable. The result is that, the research base is too 

slin to serve as a 'reliable guide for selecting teacher behaviors for study 

' and certainly too v;eak to serve as a standaW for assessing teacher 

i 

effectiveness. - 

Proposition U : Student achievement is not assured even when validated 
teaching skills are \ised. ' 

Suppose a number of experirnental stiidies (like those just described) 
' have been conducted and evidence is available to show that certain teaching 
skills influence what students learn. Can we then assess the^ skills of 
teachers and assprt th^t they are -effective if they demonstrate the appropriate 
actions and ineffective if they db^not. We cannot — and that pecxiliar . con- 
dition is one we nnis;^ live with even when many teaching skills have been valid- 
. ated (i.e., shown to influence student outcotnes). 
^ Even when teachers use validated teachinp skills we can not be certain 

that they are effective in helping students leam. Conversely, when teachers 
fail to use validated teaching skilly we can not be certain that they are in- 
effective. Said differently, a. teacher can follow all the rules and students 
may still, fAi^ to leam or fail to follow the rules and^ yet produce good re- 
suits. The reason this is so is because teach'ing is much like weather pre- 
dicting. The weather predictor knows that frontal systerns^ air flow patterns, 
and terrain all influence the weather. But weather predictions are not per- 
^fect based on this infownation because there are miny conplex factors. that can 
interact with one another. The same, holds true for education. We may know 
that amount of practice, student motivation, and kinds of questions all io- 
fluence what students leam. But the predictions of whether students will 

. / . ■ ■ 
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leana in a given situation pre less than/^rfect because the factors in- 
. fluencing learning are xnaxiy and by no' means i under' the control of the 
teacher* 



Procedx^s For Assessing Student Performance ^ ' 

Thr^^ procedures will be described that can be used to euiswer questions 

about the effective^^^ss of teachers. Each procedure involves collecting some 
• '/*•• ' 

\ • 

, kind of evidence from students as a means of assessing teachers. The procedures 
range from those with a successful history to those that show promise but have 
been little used. ^ f • - 

. , ■ ■ f . ■ 

Teaching Perforpance Test ^ 

o In a teaching performance test (Popham, 1971), teachers are given one or 
more objectives on a topic and told to prepare and deliver a short- unit of in- 
struction on the objectives- Ther instruction may be as short as a few minutes 
or last for several ^ass periods. Post-tests on the objectives are provided^ 
^along with a brie'f description of the topic." The teachers do not see -the post 
test until instruction completed although they should be able to infer the 
type- of questions on it by examining the objectives. Several Likert-type items 
are also provided for assessing the attitudes of students '^ward the I'natruction 
they receive. Hius the t<»aching performance test is a compact way of assess- 
ing how able teachers are in bringing about student achievement for a short 
unit of instruction*' The student scores on, the post-test and r^ponses on 'the 
attitude items provide evidence of both cognitive and affective effectiveness. 
Teaching performance tests provide a controlled setting for assessing 

8 



the effectiveness of teachers in either pre-service teacher training programs* 
or in on-the-job settings. Popham selects novel topics for his performance 
tests so that prior knowledge of teachers and students has a minimal in-, 
fluence on the results. Rezba, et al. (1975) have develop.ed performance 
tests in scxence to assess the effectiveness of student teachers in a field- - 
based methods course. Information on how to construct and ^e teaching 
performance. tests is available (Popham, 1973). 

Contract Teaching 

McNeil tl967) describes an exarap'le of a teaching contract in which pre- 

«^ \ 
service teachers obta"ined agreement fron their supervising teachers on sp>eclfic 

V 

objectives that .were to be accomplished by- students. If most of the students 
achieved most of the objectives the student teachers were to be gra'ded^as 
effective. For lesser accomplishment with students, the student teachers were 
to be graded accordingly. The same tactic of establishing* standards for 
student achievement can be used by inservice teachers for either single units 
of instruction or* entire school terms* The key is to establish and agree on 
.specific objectives to be accomplished and specific levels of student perform- ' 
ance on the objectives. The agreement can be made between a teacher and either 
an administrator or department ne^d. Both the level of the objectives and the 
level of student performance can be adjusted for the situation in which the 
teacher works. Some students are more teachable than others and contract ex- 
pectations can be adjusted to take this into account. 



Peer Expectations • * 

The principal danger ii> using student achievemenf as a measure of 
teaching efrectxveness is that unreasonable performailce expectations may 
sfet. In some schools it is relatiyely easy for even unskilled teachers to 
'show top 'student achievementi. In other schools the most diligent efforts may 
result in minimal'learning. Another problem to be coiisidered is the danger of 
teachers setlring easy aci\ieveinent standards if they know they will be judged on 
how well their students achieve. How are these factors to §e taken into con-^ 
sideration when • deciding if a teacher is effeTctive? p 

A method to coianteract the problems just mentioned is use of peers 
(fellow teachers who knov; both the teaching content a^d the insti^uational set- 
ting) to set reasonable standards for pupil achievement.' How would this work? 
Suppose a ninth grade physical- science • teacher is -to be assessed for effectiv-^ 
ness* - Two or three colleagues of the teacher can examine the objectives the ^ 
'teacher, has set for a ur;it and judge their 'quality. They need to determine 
whether they are important to •^he topic, comprehensive 'in coverage, and ap- 
propriate for the students. ^ Secondly the colleagues need to set reasonable 
standai^s .for achievement of the objectives with the students. If the studepts 

are both able and highly mctivatea they would expect higher^ performance than 
• * * 

for students of less ability and lower aspirations. 

Use of peer expectations is a procedure that may get us out of the 
dilemma of how to establish expectations for teacher effectiveness. Peer ex- v, 
pectations can take into consideration what is being taught, who is being 
•taught, and where instruction is taking place. 



Some Final Cbhsifierations 

We have for too- long avoided direcr measures of teaching effective.- 
ness. The result is a stagnant profession that passes out rewards to * 

all teachers without consideration for their diffeifent .abilities and efforts 

\ 

It has resulted too in teachers that are less able than they could be. 

A rapid change to a teacher accountability system based on student 
achievement is not likely and unwise considering the problems in assessing ' 
teachers (cf . , Berliner, 1976; Soar, 1977). But we could ajid should begin 
to move in the direction of assessing the effectiveness of teachers' based 
on measures of what learners are able to do. - 
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